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1.   Introduction 

It  is  novvf  generally  recognized  that  the  use  of  recall  methods  for 
collecting  expenditure  data  for  frequently  purchased  products  is  inade- 
quate (Flueck,  V/aksberg,  and  Kaitz,  1971;  Pearl,  1968;  Sudman,  1964; 
Sudman  and  Ferber,  1971).  The  single  best  alternative  to  recall  proce- 
dures is  the  use  of  diaries,  and  this  is  the  method  adopted  by  tlie  U.S. 
Bureau  of  the  Census  for  the  national  Consumer  Expenditure  Survey  being 
conducted  in  1972-73. 

Diary  methods  are  not  perfect,  however.   A  major  problem  that  remains 
to  be  investigated  is  the  danger  of  sample  biases  due  to  the  unwilling- 
ness or  inability  of  some  households  to  keep  written  records,  a  problem 
especially  severe  among  less  v^/ell  educated  households,  particularly  in 
the  inner  city.  The  present  pilot  study  was  undertaken  by  the  Survey  Re- 
search Laboratory  (SRL)  of  the  University  of  Illinois  with  the  cooperation 
of  the  Bureau  of  the  Census  to  test  the  diary  approach  against  some  al- 
ternatives. Tlie  chief  alternative  considered  was  the  use  of  daily  tele- 
phone calls  to  the  household,  a  method  suggested  by  Flueck,  IJaksberg, 
and  Kaitz  (1971)  and  by  the  growing  success  of  SRL  and  other  organizations 
with  telephone  interviewing.  Another  alternative  tested  was  the  respon- 
dent's free  choice  of  weekly  diaries,  daily  telephone  calls,  or  the  use  of 
a  tape  recorder. 

The  relative  effectiveness  of  these  alternative  methods  was  compared 
on  the  basis  of  three  criteria: 
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1.  The  level  of  household  cooperation. 

2.  The  level  of  liousehold  reporting  by  expenditure  categories, 

3.  The  level  of  reported  expenditures  by  individual  household 
members  for  food  and  drink  away  from  home. 

In  addition  to  the  method  of  data  collection,  two  otiier  factors  were 
tested  to  ascertain  their  effect  on  cooperation  and  level  of  reporting: 

1.  Conpensatio?!  of  households  versus  no  compensation. --Half  the 
households  were  scheduled  to  receive  $5.00  for  keeping  a  diary  or  for 
cooperating  in  one  of  the  otiisr  collection  methods  for  two  weeks;  the 
other  households  received  no  compensation. 

2.  Auspices  of  the  survey. --In  general,  the  U.S.  Bureau  of  the  Cen- 
sus achieves  a  higher  rate  of  cooperation  on  its  continuing  surveys  than 
do  private  survey  research  organizations.   For  this  study,  we  attempted  to 
learn  whether  auspices  would  have  any  effect  on  cooperation  or  on  report- 
ing of  consumer  expenditures.  Half  the  households  received  an  advance  let- 
ter signed  by  the  Director  of  the  Bureau  of  the  Census  while  the  other 
half  received  a  letter  signed  by  the  Director  of  the  Survey  Research  La- 
boratory (see  Appendix  B) .  Uliile  the  interviewer  was  always  identified 

as  being  from  SRL,  in  lialf  the  cases  the  respondent  was  told  the  data 
were  being  collected  for  the  Census  Bureau  and  in  the  other  half  that  the 
data  were  being  collected  for  SRL. 

Sampling  Design 

The  study  was  conducted  in  the  Chicago  Standard  Metropolitan  Statistical 
Area  during  the  period  of  April-August,  1972.  The  sample  households  selected 
were  a  subsample  of  the  master  sample  for  Illinois  selected  and  listed  by 


-3- 

the  Survey  Research  Laboratory.  Tliis  sample,  v;!iich  is  used  for  a  variety 
of  purposes,  is  a  multistage  area  probability  sample  of  the  state.   Census 
tracts  and  blocks  or  segments  v\;ithin  tracts  have  been  selected  with  proba- 
bilities proportionate  to  size.  The  selected  blocks  have  been  listed, 
and  the  sampling  rates  within  each  block  are  computed  and  households  se- 
lected as  required  for  each  new  study.   In  this  study,  only  the  listings 
for  the  Chicago  SiISA  were  used,  with  differential  sampling  rates  in  the 
central  city  and  suburban  areas. 

Households  were  randomly  assigned  to  the  method  of  data  collection, 
compensation  or  no  compensation,  and  auspices  of  the  study.  Of  the  liouse- 
holds  that  were  given  a  choice  of  keeping  a  diary,  receiving  daily  phone 
calls,  or  using  a  tape  recorder,  none  chose  the  tape  recorder  and  only  a 
few  selected  the  daily  phone  calls,  while  most  preferred  to  use  the  diary. 

Field  Procedures 

Every  selected  household  received  an  advance  letter  telling  it  about 
the  survey.   Depending  on  the  auspices,  this  letter  was  either  on  Census 
Bureau  or  SRL  stationery  and  signed  by  either  the  Director  of  the  Census 
Bureau  or  the  Director  of  SRL.   All  households  received  an  identical  ini- 
tial interview  asking  about  usual  shopping  behavior. 

After  the  initial  interview,  the  respondents  were  asked  to  provide 
expenditure  information  for  the  next  two  weeks  by  the  method  to  which  they 
had  been  assigned.  Ho  switching  was  permitted.  Thus,  a  respondent  who 
refused  to  keep  a  diary  but  might  have  been  willing  to  reS'-)ond  by  tele- 
phone was  treated  as  a  refusal.. 
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Diaries  were  picked  up  at  the  end  of  each  u'eek,  while  phone  calls  were 
made  daily.   At  the  end  of  the  two-veek  period,  a  final  interview  was  con- 
ducted with  all  available  household  r.embers  other  than  the  respondent  to 
obtain  information  on  food  and  drink  purchased  away  from  liome  and  clothing 
purchases . 

Organization  of  Results 

Tlie  main  results  of  this  study  are  discussed  in  the  four  sections 
that  follow.   The  next  section  considers  the  effect  of  the  alternative  pro- 
cedures for  data  ml  lection  on  cooperation.   Section  5  discusses  the  ef- 
fects of  the  alternative  procedures  on  the  level  of  household  reporting  by 
expenditure  categories,  while  Section  4  relates  to  individual  reports  of 
expenditures,  especially  for  food  and  drink  away  from  home.   Section  5 
deals  v;ith  the  costs  of  the  various  alternative  methods.   Section  6  dis- 
cusses some  of  t'ne  operational  procedures  used  in  the  study,  and  a  final 
section  briefly  summarizes  the  results  and  suggests  some  possible  impli- 
cations as  well  as  possible  additional  research. 
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2.   Effect  of  Alternative  Procedures  on  Cooperation 

Initial  Cooperation 

Initially,  409  households  were  selected,  288  in  the  city  of  Chicago 
and  121  in  suburban  areas.   As  is  evident  from  Tabic  1,  which  gives  the 
results  of  the  initial  contacts,  the  overall  cooperation  rate  was  only  60 
percent,  with  high   refusal  and  noncontact  rates.   This  was  due  to  lack  of 
concentrated  follow-up  activity  on  refusals  and  noncontacts  to  the  initial 
interviev/.  \!e   decided  to  allocate  the  limited  resources  available  almost 
exclusively  to  obtaining  cooperation  on  the  consumer  expenditure  portion 
of  the  study,  although  had  we  anticipated  that  the  response  rates  would  be 
so  low,  more  effort  might  have  been  allocated  to  increasing  response.  I'.Tiile 
this  relatively  low  cooperation  should  be  kept  in  mind,  we  have  no  reason 
to  suspect  that  it  has  any  major  impact  on  the  comparisons  of  the  alterna- 
tive data-collection  methods. 

As  one  might  suspect,  cooperation  was  slightly  higlier  in  the  suburbs 
than  in  the  central  city.  Overall,  Census  Bureau  auspices  resulted  in  a 
slightly  higher  initial  cooperation  rate  than  did  Survey  Research  Laboratory 
auspices.  There  appears  to  be  an  interesting  interaction  in  these  results, 
however.  V/hile  there  was  only  a  one  percentage  point  difference  for  coop- 
eration between  Chicago  and  suburbs  under  SRL  auspices,  there  was  almost  a 
10  point  difference  betv/een  Qiicago  and  suburbs  under  Census  Bureau  aus- 
pices. Tlius,  v.'hile  government  auspices  produced  higher  cooperation  in  both 
Chicago  and  suburbs,  they  were  more  effective  in  tlie  suburbs. 
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TABLE  1 
COOPERATION  OF  SAtiPLE  ON  INITIAL  INTERVIEW 
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Total 

Ch 

ica^o 

Suburbs 

Result         ; 

1 

N 

Percent 

N 

Percent 

il 

Percent 

! 

Total  sample: 

Total  selected       ' 

1 

422 

301 

121 

Vacant  or  nondwelling  \ 

44 

38 

6 

Total  occupied       ! 

378 

100.0 

263 

100.0 

115 

100.0 

Initial  interviev;     1 

cojapleted          j 

227 

60.1 

154 

58.6 

73 

63.4 

Refusal 

78 

20.6 

54 

20.5 

24 

20.9 

Noncontact 

57 

15.1 

40 

15.2 

17 

14.8 

Other  (language, 
illness,  etc.) 


16 


4.2 


15 


5.7 


0.9 


Census  Bureau  auspices: 


Total  occupied 

197 

100.0 

141 

100.0 

56 

100.0 

Initial  interview 

completed 

124 

62.9 

85 

60.3 

39 

69.6 

Refusal 

35 

17.8 

26 

18.4 

9 

16.1 

Noncontact 

29 

14.7 

21 

14.9 

8 

14.3 

Other      "   "^ 

.9 

4.6 

9 

6.4 

Ct 

D 

SRL  auspices : 

Total  occupied 

181 

100.0 

122 

100.0 

59 

100.0 

Initial  interview 

completed 

i   103 

56.9 

69 

56.5 

34 

57.6 

Refusal 

i    '' 

23.7 

28 

23.0 

15 

25.4 

Moncontact 

28 

15.5 

19 

15.6 

9 

15.3 

Other 
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3.9 
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4.9 
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Tliere  were  no  differences  in  initial  cooperation  due  to  the  inter- 
viewers' knowledge  of  the  diary  form  and  the  compensation  that  respondents 
were  to  receive.   In  an  earlier  study,  interviewers'  knowledge  of  whether 
respondents  wei'e  to  receive  compensation  did  influence  initial  cooperation 
(Sudman  and  Ferber,  1971).  Hov/ever,  in  that  study  only  diaries  were  tested 
while  here  phone  and  choice  alternatives  were  available.  This  more  com- 
plex design  may  have  reduced  or  eliminated  interviewer  concern  about  com- 
pensation. I'Jhatever  the  reason,  tlie  earlier  finding  is  not  replicated  in 
this  study. 

Panel  Cooperation 

Of  the  three  variables  studied,  compensation  appears  to  be  the  most 
important,  as  may  be  seen  in  Table  2.   About  85  percent  of  the  interviewed 

TABLE   2 
PAi>IEL  COOPERATION   BY  ALTER.NATIVE  PROCEDURES 


Procedure 


Percentage  Level  of  Cooperation 
Full   Partial  Refusal  Total 


Method : 
Diary 
Telephone 
Choice 

Compensation: 
Yes 
No 

Auspices : 

Census  Bureau 
SPX 


71.3 

4.6 

24.1 

100.0 

75.4 

7.2 

17.4 

100.0 

73.3 

5.6 

21.1 

100.0 

79.3 

5.4 

15.3 

100.0 

67.2 

6.0 

26.8 

100.0 

72.6 

4.0 

23.4 

100.0 

73.8 

7.8 

18.4 

100.0 

87 
69 
71 

111 
116 

124 
103 
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households  who  were  conroensated  participated  in  the  panel  for  all  or  part 
of  the  two-week  period  while  only  73  percent  participated  if  they  were  not 
compensated. 

The  results  are  sharpened  if  one  separates  Chicago  and  suburban  re- 
spondents (Table  3) .   There  it  may  be  seen  that  neitlier  compensation  nor 
the  diary  or  telephone  method  made  any  difference  in  the  suburbs.   In 
Chicago,  however,  85  percent  of  the  liouseholds  who  were  compensated  parti- 
cipated while  only  68  percent  participated  if  they  were  not  compensated. 
Also,  in  Chicago  82  percent  of  the  households  contacted  by  plione  gave  some 
information,  compared  to  73  percent  v<;ho  kept  diaries.  One  might  have 

TABLE  3 
PANEL  COOPErCiXTION  IM  CHICAGO  AND  SUBURBS  BY  ALTER?^IATIVE  PROCEDURES 


Procedure 


Percent  Cooperating  Fully  or  Partially 


Method: 
Diary 
Telephone 
Choice 

Compensation: 
Yes 
No 

Auspices : 

Census  Bureau 

SRL 


Chicago 


72.6 
81.6 
74.4 


84.9 
67.9 


73.7 
82.6 


(62) 
(49) 
(43) 


(73) 
(81) 


(95) 
(69) 


Suburbs 


84.0 
85.0 

85.7 


84.2 
85.7 


89.7 
79.4 


(25) 
(20) 
(28) 


(38) 
(35) 


(39) 
(34) 


NOTE:  In  this  and  subsequent  tables,  figures  in  parentheses  are  the 
base  numbers  for  the  accompanying  percentages. 
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expected  that  those  given  a  choice  would  have  had  the  highest  cooperation, 
but  that  was  not  the  case;  cooperation  in  this  group  was  about  the  same  as 
that  for  diary  keepers,  since  in  fact  most  of  these  households  chose  to 
keep  diaries. 

Tlie  standard  errors  of  the  differences  in  Table  2  are  about  5  percen- 
tage points  and  in  Table  3  about  7  percentage  points  for  Chicago  and  10 
percentage  points  for  tlie  suburbs.  Thus,  while  tl\e  differences  between 
compensation  and  no  compensation  are  statistically  significant,  particu- 
larly if  combined  v.'ith  earlier  results,  the  other  differences  are  not 
clearly  significant. 

The  results  for  auspices  seem  suggestive  and  deserve  additional  ex- 
ploration, even  if  not  statistically  significant.  In  the  suburbs,  90  per- 
cent of  the  households  contacted  under  Census  Bureau  auspices  cooperated 
in  the  panel,  compared  to  79  percent  contacted  under  Survey  Research 
Laboratory  auspices.  In  the  city,  however,  this  pattern  is  reversed;  83 
percent  of  the  households  cooperated  under  SRL  auspices  while  74  percent 
cooperated  under  Census  Bureau  auspices. 

In  Table  4,  the  data  for  the  city  of  Chicago  are  split  by  whether  com- 
pensation was  received  and  by  method  and  auspices.  The  results  are  shown 
separately  since  no  interactions  were  detected  in  these  data;  for  each 
method  and  auspices,  the  difference  in  cooperation  between  those  who  did 
and  did  not  receive  compensation  was  about  the  same.  Thus,  almost 
nine-tenths  of  the  households  in  Chicago  cooperated  fully  or  partially  in 
the  panel  if  they  received  compensation  and  were  contacted  by  phone,  while 
only  about  tv;o-thirds  cooperated  if  asked  to  keep  a  diary  with  no  compen- 
sation. 
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TABLE  4 


PANEL  COOPERATION  IN  CITY  OF  CHICAGO  BY  ICTIiOD, 
AUSPICES,  AND  COMPENSATION 


Procedure 

Percent  Cooperating 

Fully 

or 

Partially 

Compensation 

No 

Compensation 

Method: 

Diary 

Telephone 

Choice 

S0-«  (26) 

^^•^  (26) 
85.7  (21) 

''■'    (36) 
''■'    (23) 
^^•^  (22) 

Auspices : 

Census  Bureau 
SRL 

«0-^  (36) 
«^-2  (37) 

63.3  (^g^ 
''■'    (32) 

It  would  appear  that  telephones  do  offer  the  opportunity  to  increase 
cooperation  in  the  inner  city,  particularly  when  combined  with  compensa- 
tion, if  the  data  received  over  the  phone  are  comparable  to  those  obtained 
from  diaries.   This  is  discussed  in  the  next  section. 
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5.   Effect  of  Alternative  Procedures  on  Household  Reporting 

Phone  versus  Diary 

One  might  hope  that  there  would  be  no  differences  between  daily  re- 
call and  diary  methods,  but  this  was  not  the  case.   There  were  substantial 
differences  in  the  number  of  purchases  reported  and  less  important  differ- 
ences in  reported  expenditures.   These  differences  were,  however,  in  a  dif- 
ferent direction  from  those  found  with  longer  recall  periods--daily  recall 
was  lower  than  diary  reporting. 

As  seen  in  Table  5,  the  number  of  purchases  reported  by  phone  averaged 
75  percent  of  that  reported  in  diaries.   Only  in  the  "all  other  food"  cate- 
gory was  the  number  reported  by  phone  higher  tlian  the  number  reported  by 
diary,  suggesting  that  interviewers  and  coders  had  greater  difficulty  in 
classifying  purcliases  over  the  phone. 

Besides  reporting  error,  one  other  possible  explanation  for  the  dif- 
ferences observed  in  Table  5  is  that  some  or  all  of  them  might  be  due  to 
differing  purchase  patterns  by  the  phone  and  the  diary  households.   Although 
the  experimental  design  controlled  for  differing  purchase  patterns  by  ran- 
domly assigning  families  to  phone  and  diary  treatments,  the  differential 
cooperation  and  the  selection  of  either  diaries  or  phones  by  those 
households  given  this  clioice  could  confound  these  results.  However, 


The  three  recording  methods  presented  to  respondents --diary,  phone, 
and  choice  of  either--are  combined  into  diary  versus  phone  for  the  purpose 
of  this  and  later  analyses  because  only  10  respondents  selected  the  tele- 
phone of  those  given  a  choice. 
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sampling  bias  factors  cannot  accoimt  for  all  or  even  a  majority  of  the 
observed  differences. 


TABLE  5 

AVERAGE  NUi.'iiER  OF  DAILY  PURCHASES  AIJD  AVEiVvGE  DAILY  EXPEiJDITURLS 
BY  TYPE  OF  PRODUCT  FOR  DIARY  AIv'D  TELEPHONE,  !JEEKS  1  ATID  2 


1 

Numb 

er  of  Purchases 

Dail 

y  Expenditures 

Type   of  Product        ' 

Ratio  of 

Ratio  of 

Diary 

Phone 

Phone 

Diary 

Phone 

Phone 

! 

to  Diary 

to  Diary 

1 
Dair>'  ajid  bakery            ; 

• 

1.17 

.81 

.69 

$    .90 

$1.29 

1.43 

Meat,    fisli,  poultry      .' 

.79 

.50 

.63 

1.42 

1.04 

.73 

Fruits   and  vegetables ■ 

.91 

.64 

.70 

.54 

.37 

.69 

Beverages                          '■ 

.49 

.35 

.71 

.63 

,60 

.95 

All  other  food                i 

1.24 

1.31 

1.06 

1.14 

1.09 

.96 

Total   food 

4.60 

3.61 

.78 

4.63 

4.39 

.95 

Meals   and  snacks            j 

.79 

.49 

.62 

1.54 

1.10 

.71 

Clothing,    linens            i 

.29 

.25 

.86 

2.38 

2.22 

.93 

All  other  purchases      J 

2.69 

1.93 

.72 

18.83 

14.66 

.78 

Total  purchases 

8.37 

6.28 

.75 

27.38 

22.37 

.82 

Number  of  cases: 

Keek   1                    j 

107 

67 

107 

67 

Weeic  2                     ■ 

100 

62 

100 

62 

/^s   an  extreme  case,  assume  for  the  moment  that  houseliolds  in  the  city 
of  Chicago  who  v/ere  willing  to  cooperate  by  phone  but  not  by  diary  had  a 
purchase  rate  only  half  that  of  households  v;ho  kept  a  diary.  The  results 
of  Table  3  for  the  city  indicate  that  approximately  10  percent  more  house- 
holds were  willing  to  cooperate  by  telephoning  than  by  diary.  Combining 
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these  figures,  tlie  raaximura  difference  due  to  sample  bias  would  be  about 
5  percent.  Even  if  one  assumed  a  purchase  rate  for  telephone  households 
only  one-third  that  of  diary  Iiouseholds,  the  maximum  difference  would 
be  only  7  percent.   Since  the  actual  differences  in  the  purchase  rates 
are  likely  to  be  even  smaller  than  in  our  assumptions,  sample  biases  un- 
doubtedly account  for  less  than  5  percent  of  the  differences. 

The  differences  are  also  too  large  to  be  attributed  to  sampling  er- 
rors, as  may  be  seen  by  observing  the  sampling  error  estimates  given  in 
Appendix  A. 

Tae   differences  in  reporting  may  be  due  to  interviewer  as  well  as 
respondent  omissions  on  the  phone  interview.  Since  no  effort  was  made 
to  control  interviewer  assignments  in  this  experiment,  no  measure  of  in- 
terviev;er  effects  is  possible. 

The  differences  in  average  daily  dollar  expenditures  were  much  more 
variable  by  product  class  type  than  the  differences  in  the  number  of  pur- 
chases.  For  dairy  and  bakery  products,  exjienditures  reported  on  the  phone 
were  much  higher  than  in  the  diaries,  although  for  all  purchases  reported, 
phone  ex]oenditures  were  lower  than  diary  expenditures .   The  differences 
in  durable  goods  and  services  would  not  be  very  important,  since  diaries 
or  phone  recall  would  not  usually  be  used  on  purchases  other  than  food  and 
meals  because  of  lov;  incidences  of  purchasing  in  a  short  period  of  time. 

How  does  one  explain  the  different  results  for  number  and  dollar 
value  of  expenditures?  One  explanation  is  that  respondents  remembered 
the  total  amount  of  money  spent  for  food  during  the  day,  but  forgot  some 
of  the  details.   If  tliis  is  borne  out  in  additional  experiments,  it  would 
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suggest  that  phone  interviews  could  be  used  to  improve  estimates  of  total 
daily  expenditures,  but  would  not  be  as  useful  for  the  details. 

One  question  of  continuing  concern  in  any  panel  is  the  possibility 
of  conditioning  effects.   In  this  experiment,  one  would  be  able  to  ob- 
serve these  effects  if  there  had  been  major  differences  in  the  results 
of  Week  1  versus  l\'eek  2.   Table  6  indicates  that  there  were  no  significant 

TABLE  6 

AVEMGE  NUIIBER  OF  DAILY  PURCHASES  AND  AVERAGE  DAILY  EXPENDITURES  BY 
TYPE  OF  PRODUCT  FOR  DIARY  AiMD  TELEPHONE  BY  WEEK  1  VERSUS  WEEK  2 


liumber  of 

Purch:. 

scs 

'-•?. 

ilv  Exnenditurcs 

Type  of  Product         i 

Diary 

Phone 

Di 

ary 

Phone 

Week 

1 

Week 
2 

Week 

1 

Week 

2 

IVeek 
1 

Week 
2 

Week 

1 

Week 
2 

Dairy  and  bakery          ] 

1.21 

1.10 

.82 

.81 

$    .87 

$    .92 

$    .66 

$2.04 

Meat,    fish,  poultry 

.81 

.75 

.48 

.54 

1.41 

1.45 

1.04 

1.11 

Fruits   and  vegetables 

.97 

.88 

.67 

.64 

.60 

.51 

.41 

.36 

Beverages                          : 

.48 

.50 

.40 

.31 

.62 

.66 

.79 

.43 

All  other  food               j 
Total   food                   ; 

1.12 

1^4^ 

1.21 

1.51 

.74 

1.62 

1.23 

1.03 

4.59 

4.64 

3.58 

3.81 

4.24 

5.16 

4.13 

4.97 

Meals  and  snacks          ; 

.82 

.79 

.46 

.54 

1.40 

1.70 

1.06 

1.17 

Clothing,    linens           i 

.29 

.30 

.24 

.27 

2.08 

2.80 

1.96 

2.68 

All  other  purchases    I 

2.84 

2.56 

1.80 

2.08 

20.92 

17.34 

13.55 

15.28 

Total  purchases        1 

8.54 

8.29 

6.08 

6.70 

28.64 

27.00 

20.70 

24.10 

Number  of  cases        • 

107 

100 

67 

62 

conditioning  effects  for  diary  keepers.   Both  on  the  number  of  purchases  and 
average  daily  expenditures  on  food  items  and  meals,  none  of  the  differences 
was  larger  than  one  would  expect  due  to  sampling  variability.  This  supports 
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tlie  findings  of  the  earlier  study  (Sudman  and  Ferber,  1971),  which  also 
indicated  no  conditioning  effects. 

For  the  phone  interviews,  however,  there  is  some  indication  of  an 
increase  in  the  number  of  purchases  and  average  daily  expenditures  in  the 
second  week  as  compared  to  the  first,  although  because  o£  tlie  large  sam- 
pling variability,  these  results  are  only  suggestive.  Even  in  the  second 
week,  tlie  number  of  food  items  that  phone  respondents  reported  having 
purchased  is  only  80  percent  of  that  reported  in  diaries. 

Compensation  Effects 

One  would  not  expect  that  compensation  should  influence  the  accuracy 
of  reporting  once  cooperation  is  obtained,  but  in  our  earlier  study  we 
found  that  noncompensated  houseliolds  reported  less  completely  than  com- 
pensated households.  Tlie  same  results  are  not  evident  in  this  experiment. 
Controlling  for  city-suburban  location  and  diary-phone  metliods,  no  sig- 
nificant differences  are  found  in  the  number  of  items  reported  in  total, 
for  food  products  only,  or  by  individual  product  class  types. 

Vie   can  only  speculate  why  compensation  affected  reporting  on  the 
earlier  experiment  but  not  on  this  one.   The  earlier  experiment  tested 
periods  up  to  four  v/eeks,  and  the  greatest  differences  between  compen- 
sated a:id  noncompensated  households  were  found  in  the  third  and  fourth 
weeks.  Thus,  shortening  the  record-keeping  period  for  the  nresent  experi- 
ment reduced  the  effects  that  compensation  had  on  the  level  of  diary  re- 
cording.  Still,  for  the  first  two  weeks  combined,  there  was  about  a  10 
percent  difference  in  reported  level  of  expenditures  between  compensated 
and  noncompensated  households  on  the  earlier  experiment,  as  compared  to  no 
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difference  this  time.  Aside  fron  sampling  error,  there  may  have  been  some 
interviewer  effects  since  the  previous  study  stressed  gifts  as  a  major 
variable,  with  three  different  gifts  being  tested,  while  this  time  the 
major  variable  was  use  of  telephones. 

Ausnices 


On©  would  not  expect  auspices  to  affect  the  level  of  reporting  of 
cooperating  families,  and  it  docs  not.  There  are  no  differences  in  the 
number  of  expenditures  reported  between  families  recruited  under  Census 
Bureau  auspices  and  those  recruited  under  Survey  Research  Laboratory  aus- 
pices. On  dollar  expenditures  for  food,  SRL  ausniccs  resulted  in  higher 
reported  levels  than  Census  auspices,  but  these  results  are  likely  to  be 
due  to  sampling  variability  and  differential  cooperation. 

The  same  differences  are  not  observed  for  total  purchases  or  for 
number  of  purchases.  The  possibility  that  the  results  may  be  due  to  dif- 
ferent household  characteristics  of  the  respondents  using  each  of  the  al- 
ternative methods  is  considered  as  part  of  the  regression  analysis  to  be 
discussed  next. 

Multiple  Regression  Analysis 

In  order  to  investigate  the  extent  to  which  the  differences,  or  lack 
of  differences,  observed  that  were  ascribed  to  the  experimental  variables 
might  in  fact  be  a  manifestation  of  differences  in  the  socioeconomic  char- 
acteristics of  the  households,  a  stepwise  multiple  regression  analysis 
was  undertaicen  to  estimate  the  relative  importance  of  these  different 
factors  in  influencing  the  reported  number  of  purchases  and  the  average 
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daily  expenditures.   Four  dependent  variables  were  used  in  these  regres- 
sions, all  with  the  household  as  the  unit  of  observation.  These  variables 
were: 

1.  Number  of  daily  purchases  of  food  products. 

2.  Number  of  daily  purchases  of  all  products  and  services. 

3.  Daily  dollar  expenditures  for  food  products. 

4.  Daily  dollar  expenditures  for  all  products  and  services. 

The  independent  variables  included  initially  were  household  size, 
household  income,  education  of  household  head,  and  the  following  duminy 
variables:  oimership  of  home,  residence  in  suburb,  phone  kept  instead 
of  diary,  compensation  paid,  and  SRL  auspices. 

The  results,  in  Table  7,  support  those  in  Tables  5  and  6.  For  both 
number  of  food  purchases  and  total  purchases,  only  three  factors  are  sig- 
nificant in  the  regression--household  size,  household  income,  and  whether 
the  household  kept  a  diary  or  reported  by  phone.  These  three  variables 

explain  a  fairly  sizable  portion  of  the  variance  in  the  dependent  variables. 

2 
For  food  purchases,  the  variance  explained  by  the  regression  (R  )  is  .29. 

For  all  purchases,  the  explained  variance  is  .35. 

For  dollar  expenditures  on  food,  whether  the  respondent  kept  a  diary 
or  reported  by  phone  does  not  enter  significantly  into  the  regression, 
but  it  is  significant  at  the  .05  level  on  expenditures  for  all  products. 
Tiie  sign  of  the  coefficient  is  negative,  supporting  the  prior  comments 
on  the  larger  average  purchases  reported  by  diary. 

A  surprise  variable  that  enters  into  the  regression  is  auspices.   For 
food  expenditures,  SRL  auspices  yields  a  positive  beta  coefficient,  while 
for  total  expenditures,  the  beta  is  negative,  which  may  suggest  that  both 
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results  are  due  to  sampling  variability.  Note  also  that  auspices  was  not 
a  significant  variable  in  number  of  purchases. 

TABLE  7 
IIULTIPLE  REGRESSION  ANALYSIS  OF  FACTORS  AFFECTING  RECORDING 


Dependent 
Variable 


Independent 
Variable 


Beta 


Standard 
Error 


Number  of  food  I 
purchases     i 


I 


Number  of  total 
purcliases 

Dollar  food 
expenditure 


Total  dollar 
expenditure 


Household  size  !  .304 

Household  income  |  .299 

Reported  by  phone  |  -.184 

Household  income  .365 

Household  size  .297 

Reported  by  phone  .201 

Household  size  .309 

Housenold  income  .284 

SRL  auspices  !  . 125 

Suburban  location  j  .128 

Home  ownership  I  .121 

i 

Household  income  i  .599 

Suburban   location  |  .127 

Household  size  j  .111 

SRL  auspices  t  -.100 

Reported  by  phone  !  -.088 

Compensation  paid  '  .084 


.114 
.030 
.428 

.041 
.155 
.580 

.221 
.065 
.800 
.944 


.190 
2.734 

.670 
2.448 
2.515 
2 .  444 


;  18.87 

I  18.35 

i  7.48 

I  29.71 

:  19.71 

i  9.79 


I 


18.41 

12.66 

3.36 

2.78 

2.20 

74.17 
3.69 
2.92 
2.56 
2.00 
1.81 


For  food  expenditures,   the  explained  variance  is    .28  for  the  regres- 
sion witli  four  demographic  variables--household  size,   income,   suburban 

2 
location,    and  home  o\\fnership--and  with  SRL  auspices.      However,    R     is   al- 
ready  .26  when  only  household  size  and  income  are  used,   so  the  other  three 
variables   increase  the  explained  variance  only  from   .26  to    .28. 

For  total  expenditures,   the  regression,  model  with  three  demographic 
variables    (l^ousehold  size,   income,   and  suburban  location)    and  tlie  three 
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test  variables  (SRL  auspices,  reporting  by  phone,  and  comjiensation)  ex- 
plains 40  percent  of  the  variance.  However,  38  percent  of  the  variance 
is  explained  by  the  demographic  variables  and  only  the  remaining  2  per- 
cent by  the  other  variables.  One  v/ould  have  to  conclude  that  even  if 
the  effects  of  the  test  variables  are  barely  statistically  significant, 
they  are  still  of  little  practical  importance. 


4 .  Food  and  Drink  Away  from  Home 

Several  earlier  diary  studies  have  indicated  a  serious  understate- 
ment of  food  and  drink  av.'ay  from  home  by  other  houseliold  membei's.   For 
example,  in  our  previous  experiment  reported  expenditures  were  about  half 
that  estimated  from  sales  tax  records  (Sudman  and  Ferber,  1971) .   In  this 
experiment,  at  the  conclusion  of  the  two  v;eeks  of  reporting  b)''  either 
diary  or  phone,  the  interviewer  asked  to  speak  to  all  other  household 
members  who  wore  faurteen  years  of  age  or  older  about  their  expenditures 
for  meals  and  snacks  that  day. 

As  seen  in  Table  8,  and  as  might  have  been  expected,  there  was  a 

TABLE  8 

ADDITIONAL  REPORTS  OF  EXPENDITURES  FOR  TEALS  MIU   SMACKS  AV.'AY 
FROM  HOI  IE  BY  OTHER  IIOUSEIMLD  MEMBERS  FOR  DIARY  AND  PHONE 


Meals  and  Snacks 


Diary 


Number  of  purchases : 

Initial  number  of  daily  purchases 
Additional  number  of  purchases  reported 
Percentage  increase  (2/1) 

Daily  expenditures: 

Initial  average  daily  dollar  expenditures 
Additional  dollar  expenditures  reported 
Percentage  increase  (5/4) 


Phone 


i79 

.49 

.83 

.69 

105% 

141% 

$1.54 

$1 

.10 

$2.01 

$ 

.98 

131% 

89% 
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substantial  increase  in  reported  exiienditures .   by  diary,  tlie  additional 
number  of  purchases  v/as  more  than  the  initial  daily  purchases  reported, 
and  the  dollar  amounts  were  about  1.25  times  more  than  t!ie  initial  amounts. 
Thus,  the  revised  estimate  is  near  to  wliat  might  be  expected  from  sales 
tax  records. 

For  plione  methods,  the  relative  increases  from  the  final  interview 
are  of  the  same  magnitude  but  below  the  diary  levels.  17here  the  daily 
reporting  of  expenditures  was  done  by  phone,  the  final  interviev/  was  also 
by  phone,  while  for  families  keeping  tlie  diary,  the  final  interview  was 
face-to-face  with  other  household  members.   It  would  appear  tiiat  diaries 
and  face-to- face  interviews  are  more  effective  than  phone  methods  in  in- 
volving other  household  members  and  increasing  the  completeness  of  recording. 

As  part  of  the  final  interview,  other  household  members  v;ere  also 
asked  about  their  personal  clothing  purchases  since  the  start  of  the  m.onth 
in  which  the  interview  took  place.   For  both  diaries  and  phones,  tiiere 
was  an  increase  of  about  one-third  in  reported  expenditures.   It  is  un- 
certain, however,  whether  this  reflects  improvement  in  the  data  or  an  over- 
statement due  to  recall  telescoping  by  other  household  members.   In  the 
earlier  study  (Sud:nan  and  Ferber,  1971),  clotliing  purchases  reported  by 
diary  agreed  closely  v;ith  sales  tax  figures. 


5.  Cost  of  Interviewing 

The  costs  of  alternative  methods  are  important  factors  in  the  ul- 
timate design  of  large-scale  data-gathering  operations.   In  this  e.xperi- 
ment,  although  interviewers  were  used  in  both  the  phone  and  the  diary 
methods,  an  effort  was  made  to  separate  times  and  expenses  between  the 
two  procedures  and  to  estimate  costs  separately  for  the  city  of  Chicago 
and  for  the  suburbs.   These  results  are  given  in  Table  9,   Tlie  cost 

TABLE  9 

TIME  Ai\D  COSTS  OF  DIARY  Al^ID  PHONE  METHODS 
m  CHICAGO  AiND  SUBURBS  PER   INTERVIE17 


Time  and  Costs 


Chicago 


Diary 


Suburbs 


Phone   Diary 


Phone 


Average  interviewer  time  (hrs.) 

Cost  @$2.50A»r. 

Travel  cost  glO^/inile  and  parking 
or  public  transportation 

Phone  charges 

Total  cost 

Ratio  of  phone  to  diary 

i 

Phone  installation  charge  s>l9-00  j 
X  15%  of  households  ] 

Total  cost  including  install ationj 
Ratio  of  phone  to  diary  i 


2.77 

5.54 

4.90 

5.54 

$6.92 

$13.85 

$12.25 

$13.85 

5.49 

1.65 

12.48 

5.24 

_- 

1.25 
16.75 

-- 

4.92 

12.41 

24.73 

24.01 

1.35 

.97 

2.85 
$19.60 


1.58 
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figures  are  on  the  basis  of  $2.50  per  hour  of  inter/iewer  time,  10<^  per 
mile  for  travel  using  private  car,  and  the  phone  rates  in  the  Chicago 
area.   Tlie  results  should  be  treated  cautiously  because,  nationally,  there 
will  be  some  variation  in  these  figures.   Also,  there  was  some  arbitrari- 
ness in  time  and  expense  allocation  when  the  interviewer  was  doing  sev- 
eral things  on  the  same  trip,  such  as  picking  up  a  diary  and  conducting 
an  initial  interviev/.  Nevertheless,  the  data  should  be  sufficiently 
accurate  for  planning  purposes. 

In  the  suburbs,  there  are  no  differences  in  the  total  costs  of  the 
two  methods,  with  the  increased  time  on  the  phone  and  the  phone  charges 
being  almost  balanced  by  the  increased  travel  time  and  expenses  for  the 
diary  method.  Since  phone  methods  do  not  increase  cooperation  in  the 
suburbs  and  result  in  less  accurate  reporting,  they  could  not  be  recom- 
mended for  those  areas. 

In  CTiicago,  phone  methods  are  about  35  percent  more  expensive  al- 
though phone  charges  are  less.  This  is  because  travel  time  and  expenses 
are  lower  in  the  city  for  the  diary  method.  Nevertheless,  there  would 
be  no  major  impact  on  costs  if  a  limited  number  of  city  interviews  were 
done  by  phone. 

This  comparison  does  not  include  the  costs  for  telephone  installation 
in  those  homes  v.'ithout  phones.  This  was  done  in  six  households  at  an 
average  cost  of  about  $19,  of  which  $12  was  for  installation  and  $7  for 
the  first  month's  service  charge.   If  phones  were  to  be  installed  in  every 
seventh  or  eighth  house,  this  would  add  an  additional  phone  charge  of 
$2.50-$3.00  per  phone  interview  and  raise  the  total  phone  charge  in  Chicago 
to  about  $20.00',  or  60  percent  more  than  the  diary  method. 


6.  Field  and  Processing  Procedures 
In  this  section,  we  discuss  briefly  the  operational  procedures  used 
in  this  study.   This  discussion  may  be  of  some  use  to  otiiers  who  might 
wish  to  duplicate  this  study  or  conduct  a  larger  consumer  expenditure 
study.  The  specific  methods  also  influence  the  cost  data  presented  above. 


Time  Schedule 
Interviewer  recruitment 

Design  of  forms  for  printing 

a.  Final  draft  of  product  diaries 

b.  Final  draft  of  final  interview 

c.  Journal  diary  for  telephone 

d.  Revised  brochure  ''IVliere  Do  Your 

Dollars  Go" 

Pretest 

Training 

Data  collection 

Training  and  data  collection- -Viave  I 

Mailing  for  home  study 

Printing 

Advance  letters 

Prepared 
Sent 

Training 

Group  1 
Group  2 
Group  3 

Field  work 

l.'ave  II 

Advance  letters  sent 
Field  work 


January  21  -  April  1,  1372 


March  10 

March  10 

March  10 

March  10 


March.  24 

Marcli  24 

March  24 

Marcli  24 


April  3 

.'\pril  3  -  April  11 


April  20 

.'^pril  10  -  April  24 

March  20  -  Anril   17 
April  24 

April  26-27 
April  28-29 
May  1 

April  29  -  July  14 


June  19 

June  24  -  August  22 
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Forms  Used 

Briefly  described  here  are  the  forms  used  in  this  experiment.  Ap- 
pendix IB  contains  copies  of  these  forms. 

1.  Dear  Friend  Letter.  Tliis  letter  was  mailed  with  a  brochure, 
"Where  Do  Your  Dollars  Go,"  to  each  sample  address  before  an 
interviewer's  initial  visit.  The  letter  explained  the  purpose 
of  the  survey  and  informed  the  occupants  that  an  interviewer 
would  call.  Interviewers  had  extra  copies  to  leave  with  re- 
spondents who  had  not  seen  it,  but  did  not  offer  the  letter 
unless  requested. 

2.  Initial  Interview  Questionnaire.  This  questionnaire  was  used 
for  interviewing  the  main  shopper  for  all  household  units  that 
entered  the  survey  during  the  data- collection  period.  The  inter- 
view was  designed  to  gather  information  on  size  of  household, 
demographic  information,  usual  place  of  shopping,  and  ty^ie  of 
store  in  v/hich  purchases  were  made. 

3.  Consumer  Expenditure  Diar>''.  The  diary  used  was  a  product  diary 
identical  to  the  diary  used  by  the  U.S.  Bureau  of  the  Census  in 
the  1972  Consumer  Expenditure  Survey. 

4.  Final  Inter/iew  Questionnaire.  The  final  interview  was  to  be 
made  witli  each  Iiousehold  member  fourteen  years  of  age  or  older 
other  than  the  main  shopper.   It  was  administered  at  the  end  of 
the  two-week  recording  period.  The  questionnaire  was  designed 
to  gather  information  frequently  missed  by  household  members 

in  consumer  recording.  Such  items  are  food  and  drink  eaten 
away  from  home  and  clothing  items. 
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5.  Telephone  Questionnaire.  This  questionnaire  was  used  to  gather 
information  by  daily  telephone  interviewing.   Because  of  the 
experimental  nature  of  the  phone  survey,  interviewers  were  en- 
couraged to  develop  individual  probing  techniques  for  eliciting 
expenditure  information.  The  structure  in  this  phone  question- 
naire served  simply  as  a  guideline. 

Staff  Utilization 

Two  supervisors  were  utilized  for  this  study.  Michael  Cox  and  Teresa 
de  Jesus  supervised  the  work  of  the  interviewers,  which  entailed  assign- 
ing work,  maintaining  weekly  records  of  field  progress,  communicating 
weekly  with  interviewers,  answering  questions  concerning  the  study,  and 
editing  completed  diaries  for  accuracy  and  completeness. 

Interviewer  Selection  and  Training 

It  was  decided  that  37  interviewers  be  selected  and  asked  to  come 
to  the  training  sessions.   It  was  assumed  that  25-30  would  remain  with 
the  study  and  work  full  time  if  possible  through  both  waves. 

Interviewers  v/ere  chosen  on  three  criteria:   (1)  interviewing  exper- 
ience evaluation,  (2)  location,  and  (3)  interest  and  availability.  The 
following  breakdoim  of  interviewers  by  area  was  determined  from  the  sam- 
ple provided  (based  on  30  interviewers) : 

Chicago  Suburbs 


North 

10 

3 

Northwest 

4 

2 

1,'est 

9 

2 

South 

2 

2 

Southwest 

5 

1 

Total  20  10 
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Of  37  potential  interviev.'ers  invited  to  the  training  sessions,  28 
attended. 

Verification 

A  total  of  39  interviews,  or  apt)roximately  20  percent  of  each  in- 
terviewer's completed  work,  was  verified  by  telephone  from  the  SRL  office 
in  Chicago.  Tlie  quality  of  all  interviewers'  work  for  this  study  was 
found  to  be  good  with  all  cases  verified  where  contact  could  be  made. 
Validation  questions  included  demographic  information  from  the  initial 
interview.  No  expenditure  questions  were  validated  since  respondent  mem- 
ory errors  would  have  prevented  meaningful  comparisons.   Five  cases 
could  not  be  verified  because  the  respondents  did  not  have  telephones, 
wliile  in  one  case  the  respondent  had  moved  to  another  state. 

Problems 


There  were  three  major  problems  with  the  study.   First,  as  already 
mentioned,  uecause  of  the  limited  resources  available,  there  v;as  no  follov.'- 
up  of  refusals  to  initial  interviews,  so  that  the  cooperation  rate  was 
lower  than  usual.  Second,  another  field  problem  arose  because  of  delays 
in  developing  forms  and  obtaining  approval  from  0MB.  Tlie  field  period 
was  delayed  and  extended  into  the  summer,  which  in  turn  lengthened  the 
field  period  since  some  Iiouseholds  v/ere  away  from  home  on  vacations. 

Finally,  there  v/ere  some  problems  with  the  punching  and  editing 
of  the  expenditure  data.   An  examination  of  the  data  frequency  distri- 
butions indicated  about  75  cases  where  the  dollar  amount  punched  for  the 
daily  expenditures  of  a  specific  product  was  susniciously  large.  Most 
of  these  proved  to  be  keypunch  errors.   Substantial  time  and  effort  would 
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have  been  saved  if  these  errors  had  been  caught  in  the  cleaning  program 
before  being  put  on  the  final  data  tape.   An  easy  way  to  do  that  would 
have  been  to  set  upper  bounds  on  the  magnitude  of  dollar  expenditure  by 
product  type  and  automatically  check  all  cases  above  that  level. 


7.  Summary  and  Implications 

In  this  section,  we  sunirnarize  the  main  results  of  this  experiment 
with  regard  to  the  variables  that  were  tested.   Implications  of  the  results 
are  discussed  and  an  assessment  is  provided  of  the  possible  effect  of  limi- 
tations on  these  results. 

Compensation 

Tlie  results  in  Chicago,  as  well  as  those  of  earlier  studies,  indicate 
that  compens  tion  did  help  to  improve  cooperation  on  record  keeping- -85 
percent  of  compensated  households  cooperated,  compared  to  68  percent  of 
noncompensated  households .  Compensation  seems  to  have  no  important  ef- 
fect in  suburban  areas,  but  it  is  difficult  to  see  how  one  could  use  dif- 
ferential compensation  systems  in  cities  and  suburbs. 

One  other  positive  effect  of  compensation  suggested  by  the  multiple 
regression  results  is  that  the  compensated  households  reported  higher  av- 
erage expenditures  than  other  households.  Although  more  expenditures  do 
not  necessarily  carry  any  presumption  of  higher  accuracy,  past  experience 
suggests  that  this  is  indeed  likely  to  be  true. 

For  these  reasons,  the  results  of  this  study  would  clearly  suggest 
that  at  least  in  terms  of  the  information  obtained,  the  offer  of  compen- 
sation may  have  highly  favorable  effects. 

Auspices 

Census  Bureau  auspices  resulted  in  higher  initial  cooperation  both 
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in  the  city  and  the  suburbs.  Panel  cooperation  v^as  higher  in  the  suburbs 
under  Census  Bureau  auspices  but  higher  in  the  city  under  Survey  Research 
Laboratory  auspices.  However,  the  final  cooperation  rates  were  about  the 
same  regardless  of  auspices. 

There  was  some  evidence  of  suspicion  of  the  government's  reasons  for 
doing  the  survey  in  the  city,  but  not  in  the  suburbs.  In  terms  of  response, 
however,  combining  initial  and  panel  cooperation  rates.  Census  Bureau  and 
SRL  auspices  produced  identical  results  in  the  city  while  Census  auspices 
were  somewhat  better  in  the  suburbs. 

Telephone  Methods 

The  results  of  the  experiment  indicate  that  telephone  procedures  may 
be  a  useful  supplement  to  improve  cooperation  in  central  cities,  where 
households  are  unwilling  to  keep  diaries.   In  suburban  areas,  there  would 
seem  to  be  no  need  for  telephone  supplementary  procedures,  and  cost  and 
recording  accuracy  problems  would  argue  against  their  use  in  these  areas. 
In  the  city,  the  telephone  would  not  solve  all  cooperation  problems,  but 
would  be  likely  to  raise  the  cooperation  level  to  that  in  the  suburbs,  or 
just  slightly  lower. 

Unfortunately,  the  data  obtained  by  telephone,  even  using  daily  recall, 
do  not  appear  to  be  as  complete  and  accurate  as  data  from  diaries.  There 
was  some  evidence  of  under-reporting  of  purchases  by  phone  households,  al- 
though not  apparently  for  the  total  amount  spent  on  food.  Phone  respondents 
reported  only  about  three-fourths  as  many  purchases  as  diary  keepers.  They 
also  reported  a  larger  number  of  purchases  that  ended  up  in  the  "all  other 
food"  category,  indicating  potential  problems  at  the  data- reduction  stage. 
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Several  strategies  would  be  possible,  given  these  results,  but  the 
choice  of  the  best  one  would  require  additional  testing.  One  could  use 
phone  data  as  they  are  and  ignore  the  possible  errors,  although  this  would 
not  seem  too  wise.  Alternatively,  one  could  use  the  dollar  expenditure 
data  by  product  class  and  estimate  by  regression  procedures  the  number  of 
purchases  or  other  details  required.  Another  method,  if  phone  interviews 
were  done  from  a  central  location  in  a  city,  would  be  to  have  them  edited 
quickly  after  the  interviews  (not  by  the  interviewer,  but  by  a  trained 
editor)  so  that  possible  errors  or  gaps  in  the  data  could  be  checked  on 
the  next  day's  interviews. 

Phone  data  do  seem  to  improve  as  the  respondents,  and  perhaps  the  in- 
terviewers, get  more  experienced,  which  might  suggest  that  the  data  for  the 
first  few  days  be  only  for  practice.  On  the  other  hand,  since  phone  inter- 
views cost  more  than  diary  methods,  a  somewhat  shorter  time  period  might 
be  considered  for  supplementary  intervieivs,  say  a  week  or  ten  days  if  the 
first  three  days  were  practice. 

The  installation  of  telephones,  where  necessary,  does  increase  coopera- 
tion and  is  administratively  easy  to  handle.  There  is  no  reason  not  to 
continue  this  procedure  for  telephone  supplementary  samples.  One  v/ay  to 
reduce  costs  would  be  to  omit  any  additional  compensation  for  these  house- 
holds, since  the  phone  installation  charge  is  itself  worth  about  four  times 
the  cost  of  the  compensation. 

All  in  all,  although  phone  methods  do  have  problems,  the  results  are 
sufficiently  promising  to  warrant  additional  testing,  especially  in  cities, 
where  diary  cooperation  is  a  serious  problem. 
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Limitations 

Any  assessment  of  the  significance  of  these  results  must  take  into 
account  the  small  scale,  the  limited  scope,  and  the  restricted  nature  of 
this  pilot  study.  In  particular,  the  study  was  carried  out  with  a  re- 
latively small  sample  size  due  to  restrictions  on  available  funds  and  was 
conducted  in  a  single  urban  area  over  a  period  of  a  few  weeks.  For  these 
and  other  reasons,  the  scope  of  the  experimental  variables  was  highly 
limited  and  the  results  should  not  be  extrapolated  to  other  situations. 
Thus,  only  one  alternative  was  considered  in  the  test  of  auspices,  and 
the  fact  that  there  was  no  difference  in  the  results  does  not  necessarily 
imply  that  a  similar  finding  would  be  obtained  if  another  type  of  auspices 
was  tested,  possibly  in  a  different  area.  In  a  roughly  analogous  fashion, 
there  is  no  assurance  that  the  same  results  with  regard  to  compensation 
or  the  use  of  telephones  v;ould  be  obtained  in  other  areas. 

The  small  sample  size  is  also  a  major  limitation  since  it  is  not  clear 
to  what  extent  observed  differences  currently  ascribed  to  sampling  varia- 
tions might  really  exist  in  a  large-scale  survey.  With  coefficients  of 
variation  up  to  10  percent  for  even  the  larger  categories,  and  considering 
the  small  sample  sizes  used  in  this  study,  differences  in  the  population 
would  have  to  be  substantial  before  they  could  be  labeled  as  such. 

A  final  limitation  is  the  disappointingly  low  rate  of  initial  coopera- 
tion. Only  about  60  percent  of  those  originally  contacted  agreed  to  coop- 
erate. Since  not  all  of  those  did  so  for  a  full  two  weeks,  the  effective 
rate  of  cooperation  is  only  47  percent  for  the  entire  sample.  IVhile  this 
low  rate  of  cooperation  was  the  result  of  a  conscious  decision  to  maximize 
sample  size  for  analysis  of  reporting,  the  cooperation  obtained  was  lower 
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than  expected.  Biases  are  likely  to  be  present  even  when  the  rate  o£  co- 
operation is  high,  and  such  dangers  must  be  considered  even  more  carefully 
when  the  rate  of  cooperation  is  low.  As  an  example,  it  is  not  clear  if 
the  group  that  did  cooperate  represented  households  for  which  an  offer  of 
compensation  really  made  a  difference  and  if  cooperation  of  the  other 
members  of  this  group  would  have  been  much  poorer  had  they  been  induced  to 
take  part  in  the  study. 

More  broadly,  the  extent  to  which  the  nonrespondents  would  have  reacted 
to  experimental  variables  in  reporting  purchases  in  a  manner  similar  to 
the  respondents  is  an  open  question.  All  that  can  be  said  is  that  we  have 
no  reason  to  believe  that  such  differences  exist,  but  clearly  this  is  a 
question  that  can  only  be  answered  by  further  testing.  In  particular,  any 
additional  tests  should  place  major  emphases  on  maximizing  cooperation  and 
on  later  comparisons  of  the  quality  of  the  data  obtained  from  the  "read- 
ily cooperative"  respondents  and  the  "reluctantly  cooperative"  respondents. 

Despite  the  limitations  of  this  pilot  study,  the  results  do  allow  us 
to  hypothesize  the  following: 

1.  An  offer  of  compensation  will  improve  both  cooperation  and  the 
quality  of  data  obtained. 

2.  Differences  in  auspices,  such  as  between  the  Bureau  of  the  Census 
and  a  part  of  a  major  state  university,  will  have  no  effect. 

3.  The  use  of  the  telephone  on  a  selective  basis  can  be  very  help- 
ful in  improving  the  response  rate  and  in  obtaining  better  quality 
data. 

It  is  hoped  that  further  studies  can  be  undertaken  that  will  incorporate 
more  comprehensive  tests  of  these  hypotheses. 
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